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Abstract 

We consider random matrices that have invariance properties under the action 
of unitary groups (either a left-right invariance, or a conjugacy invariance), and we 
give formulas for moments in terms of functions of eigenvalues. Our main tool is 
the Weingarten calculus. As an application to statistics, we obtain new formulas for 
the pseudo inverse of Gaussian matrices and for the inverse of compound Wishart 
matrices. 
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1 Introduction 

Wishart matrices have been introduced and studied for the first time for statistical pur- 
poses in [Wi] , and they are still a fundamental random matrix model related to theoretical 
statistics. One generalization of Wishart matrices is compound Wishart matrices which 
are studied, for example, in [Sj HPJ. Compound Wishart matrices appear in many topics 
such as the in the context of spiked random matrices. 

The study of eigenvalues of Wishart matrices is quite well developed but a systematic of 
the joint moments of their entries (that we will call local moments) is more recent. On the 
other hand, the theoretical study of the inverse of Wishart matrices is also very important, 
in particular for mathematical finance purposes, as shown in ( |CWj and [CMW] ) 

However, the study of their local moments is much more recent, and was actually still 
open in the case of the inverse of the compound Wishart matrix. 

The aim of this paper is to provide a unified approach to the problem of computing 
the local moments of the above random matrix models. We actually tackle a much more 
general setup, where we consider any random matrix provided that its distribution has 
an appropriate invariance property (orthogonal or unitary) under an appropriate action 
(by conjugation, or by a left-right action). 

Our approach is based on Weingarten calculus. This tool is used to compute the 
local moments of random matrices distributed according to the Haar measure on compact 
groups such as the unitary or the orthogonal group. 

It was introduced in |We] and then improved many times, with a first complete de- 
scription in [U | ICS] . 

In this paper, we need to introduce a modification of the Weingarten function, namely, 
a 'double' Weingarten function with two dimension parameters instead of one. As far as 
we know it is the first time that such a double-parameter Weingarten function is needed. 
Beyond proving to be efficient in computing systematically moments, we believe that it 
will turn out to have important theoretical properties. 

As an interesting byproduct of our study - and as a preliminary to the solution of our 
problem of computing the moments of the inverse of a compound Wishart random matrix, 
we obtain explicit moment formulas for the pseudo-inverse of Ginibre random matrices. 
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This paper is organized as follows. In section |2j we recall known results about the 
moments of Wishart matrices, their inverses, and about Weingarten calculus. Section 
|3] is devoted to the computation of moments of general invariant random matrices, and 
in section HI we solve systematically the problem of computing moments of inverses of 
compound Wishart matrices. 

2 Preliminary 

2.1 Notation 

2.1.1 Notation in the complex case 

Let k be a positive integer. A partition of k is a weakly decreasing sequence A = 
(Ai, . . . , A;) of positive integers with J2\=i ^% = ^- We write the length I of A as £(X). 

Let Sk be the symmetric group acting on [k] = {1, 2, . . . , k}. A permutation 7r G Sk is 
decomposed into cycles. If the numbers of lengths of cycles are hi > \ii > • • • > Hi, then 
the sequence \i = (hi, H2, . . . ,hi) is a partition of k. We will refer to /1 as the cycle-type 
of 7T. Denote by k(tv) the length £(fi) of the cycle-type of 7T, or equivalently the number 
of cycles of n. 

For two sequences i = (ii, . . . ,ik) and i' = . . . ,i' k ) of positive integers and for a 
permutation n G Sk, we put 

k 

8=1 

Given a square matrix A and a permutation 7r G S'fe of cycle-type /x = (/ii, . . . ,Hl), we 
define 

Tr n (A) = J]Tr(^). 
i=i 

Example 2.1. Let vr = ( 1 1 1 1 f | ? | ) G 5 g . Then tt is decomposed as tt = (1 2 5)(3 4) (6 8) (7) 
and the cycle-type of 7r is the partition (3,2,2,1), which gives k(tt) = 4 and Tr n (A) = 
Tr(A 3 )Tr(A 2 ) 2 Tr(A). 

2.1.2 Notation in the real case 

Given a G S%k, w e attach an undirected graph T(a) with vertices 1,2, ... ,2k and edge set 
consisting of 

{{2i - 1, 2i} \i = 1, 2, . . . , k} U {{a(2i - 1), a{2i)} \ i = 1, 2, . . . , k}. 



Here we distinguish every edge {2i — l,2i} from {cr(2j — l),a(2j)} even if these pairs 
coincide. Then each vertex of the graph lies on exactly two edges, and the number of 
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vertices in each connected component is even. If the numbers of vertices are 2/xi > 2/i 2 > 
• • • > 2/i/ in the components, then the sequence /i = (jii,fi%, . . . ,fi{) is a partition of k. 
We will refer to the \i as the coset-type of a, see |Macj VII. 2] for detail. Denote by k'(o) 
the length l(fi) of the coset-type of a, or equivalently the number of components of T(a). 

Let M 2 k be the set of all pair partitions of the set [2k] = {1, . . . , 2k}. A pair partition 
a G M 2 k can be uniquely expressed in the form 

a = {HI), (7(2)}, {(7(3), (7(4)}, . . . , {a(2fc - 1), a(2A;)}} 

with 1 = a(l) < a(3) < ■ ■ • < a(2fc - 1) and tr(2i - 1) < a(2i) (1 < i < fe). Then a can 
be regarded as a permutation ( CT ? 2 ) "! a(2k) ) m Sat- We thus embed M 2 fc into Sat- In 
particular, the coset-type and the value of k' for a G M 2 k are defined. 

For a permutation a G S 2 k and a 2fc-tuple i = i 2 , ■ ■ ■ , «2fc) of positive integers, we 
define 

S=l 

In particular, if cr G M 2 fc, then c^.(i) = Yl{ a ,b}ea^ia,ibi wnere the product runs over all 
pairs in a. For a square matrix A and cr g with coset-type (fii, /i 2 , . . . , /jli), we define 

I 

Example 2.2. Let 

11 ~ (25431876) ^ ^8 as in Example 12.11 Then the coset-type of it 
is the partition (3, 1), which gives k'(it) = 2 and Tr' n (A) = Tr(v4 3 ) Tr(A). 

2.2 Weingarten calculus 
2.2.1 Unitary Weingarten calculus 

We review some basic material on unitary integration and unitary Weingarten function. A 
more complete exposition of these matters can be found in [Cj ICS} IMN] . We use notation 
defined in §2X1 

Let L(Sk) be the algebra of complex-valued functions on Sk with convolution 

(fi * / 2 )(tt) = AWMt-V) (fi, h e L(S k ), tt G S k ). 
res k 

The identity element in the algebra L(Sk) is the Dirac function 5 e at the identity permu- 
tation e = efc G Sk- 

Let z be a complex number and consider the function z K ^ in L(Sk) defined by 

Sk 3 TT 1 — ^ Z KW G C, 
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which belongs to the center Z(L(Sk)) of L(Sk)- The unitary Weingarten function 

S k 3n^ Wg U (7r; z) E C 

is, by definition, the pseudo-inverse element of z K ^'' in Z(L(Sk)), i.e., the unique element 
in Z(L(Sk)) satisfying 

* Wg u (-; z) * z K{ - ] = z K ^ and Wg u (-; z) * z K ^ * Wg u (-; z) = Wg u (-; z). 

The expansion of the unitary Weingarten function in terms of irreducible characters 
X X of Sk is given by 

w § u (^) = ^ £ c^) xA(7r) (7rG5fc) ' 

summed over all parititons A of k satisfying C\(z) ^ 0. Here f x = x X { e ) an d 

CA(*)=nii(*+.*- < )- 

In particular, unless z G {0, ±1, ±2, . . . , ±(/c— 1)}, functions z K ^ and Wg u (-; z) are inverse 
of each other and satisfy z K ^ * Wg u (-; z) = 8 e . 

Proposition 2.1 QCJ). Let U = (uij)i<ij< n be an n x n Haar- distributed unitary ma- 
trix. For four sequences i = (i x , i 2 , . . . , ik), j = (J^h, ■ ■ ■ , 3k), *' = i' 2 , ■ ■ ■ > i'k), 
j' = (j[,32, ■ ■ ■ ,j'k) of positive integers in [n], we have 

E[u hjl . . . Ui^u^ - • • Ui' k f k ] = £ ^(*,* / )^r(j,j')Wg U ((x- 1 r;n). (2.1) 

We will need the following function later. Define the function Wg u (-; z, w) on Sk with 
two complex parameters z, w G C by the convolution 

Wg u (-; z, w) = Wg u (-; z) * Wg u (-; w). (2.2) 

More precisely, 



Wg»(.;z, m) = I £ ' 



X 



k\ j£ C x (z)C x (w 
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2.2.2 Orthogonal Weingarten calculus 

We next review theory on orthogonal integration and orthogonal Weingarten function. 
See [CSl EMI 1MB |M2j IMS] for detail. We use notation defined in 32JL21 

Let iffc be the hyperoctahedral group of order 2 k k\, which is the centralizer of tk in 
S^k, where G is the product of the transpositions (1 2), (34),..., (2k — 1 2k). Let 
L(S2k,Hk) be the subspace of all iffc-biinvariant functions in L(S2k)'- 

L(S 2k , H k ) = {fe L{S 2k ) | /(Co") = /K) = /(tr) (a G S 2fe , C G if*)}. 

It is a commutative C-algebra under the convolution. 

We introduce another product on L(S 2 k, Hk). For fi, f 2 G L(S2k, Hk), we define 

(/l»/ 2 )W = E G 

T6M 2)fe 

Note that /itj/2 = (2*A;!) -1 /i * f 2 - In fact, since M 2 k gives the representative of cosets 
criffc in S^fc and since fi, f 2 are iffc-biinvariant, we have 

(A* /*)(*)= E E /iC^OJ/aCW 1 ) = E E = 1^1 (/itt/a)W- 

i-eMji Ce^fc reM 2k CeH h 

The new product Jj is most of the same as the convolution * on L(S2k) up to the nor- 
malization factor 2 k k\, but it will be convenient in the present context. We note that 
L(S2k,Hk) is a commutative algebra under the product Jj with the identity element 



1*» 



1 if a e H k 
otherwise. 



Consider the function z K '^ with a complex parameter z defined by 

Z K ' {a) G C, 

which belongs to L(S2k, Hk). The orthogonal Weingarten function Wg°(o~;z) (a G S^) 
is the unique element in L(S 2 k,H k ) satisfying 

z"'^tjWg°(-; z)$z Kl{ - ] = z K 'U and Wg°(-; z)^z K '^HWg°(-, z) = Wg°(-; 2). 

For each partition A of /c, the zonal spherical function u x is defined by u x = (2 k k\)~ l x 2X * 
ln k , where 2A = (2Ai, 2X 2 , . . .), and the family of u x form a linear basis of L(S 2 k, Hk). 
The expansion of Wg (•; z) in terms of u x is given by 
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summed over all parititons A of A; satisfying C' x (z) ^ 0, where 

<(A) Xj 
i=l j=l 

In particular, if C' x (z) ^ for all partitions A of k, functions z K '^ and Wg (•; z) are their 
inverse of each other and satisfy z K ^JJWg (•; z) = l# fc . 

Let 0(n) be the real orthogonal group of degree n, equipped with its Haar probability 
measure. 

Proposition 2.2 ([CM]). Let U = {uij)i<ij< n be an n x n Haar- distributed orthogonal 
matrix. For two sequences i = . . . , i 2 k) and j = (ji, . . . , 32k), we have 

E[u hjl u i2h ---u i2khk }= ^(*)^(j)Wg°( ( r- 1 r;n). (2.3) 

o-,-reM 2fe 

Here a,r e M 2 k are regarded as permutations in S^k, and so is o v t. 

We will need the following function later. Define the function Wg°(-; z, w) in L(S2k, Hk) 
with two complex parameters z,w E C by 

Wg°(-; z, w) = Wg°(-; z)|jWg (-; w). (2.4) 

More precisely, 



2 fc A;! ^ P X . \ 



{2k)\ fa C' x (z)C' x (w) 



OJ 



2.3 Wishart matrices and their inverse 
2.3.1 Complex Wishart matrices 

Let X be an n x p random matrix whose columns are i.i.d. complex vectors which follow 
n-dimensional complex normal distributions Nc(0, £), where S is an n x n positive definite 
Hermitian matrix. Then we call a random matrix W = XX* a (centered) complex Wishart 
matrix. 

We will need the computation of the local moments for the inverse W~ l . 

Proposition 2.3 ( [GLMj ). Let W be a complex Wishart matrix defined as above. Put 
q = p — n. If n <E Sk and q > k, then 

ElTr^W- 1 )] = (-l) fc Wg U (vrr- 1 ; -q) TV^ST 1 ). (2.5) 

res k 



Integration of invariant matrices 



8 



2.3.2 Real Wishart matrices 

Let X be an n x p random matrix whose columns are i.i.d. vectors which follow n- 
dimensional real normal distributions Nr(0, £), where E is an n x n positive definite real 
symmetric matrix. Then we call a random matrix W = XX t a (centered) real Wishart 
matrix. 

Proposition 2.4 QM2]). Let W be a real Wishart matrix defined as above. Put q = 
p — n — 1. 

If 7i G M 2 k and q > 2k — 1, then 

= (-l) fc £ Wg°(7rr- 1 ; -g) T^E" 1 ). (2.6) 

TGM 2fc 

3 Invariant random matrices 

In this section we consider random matrices with invariance property and establish the 
link between local and global moments. 

3.1 Conjugacy invariance 
3.1.1 Unitary case 

Theorem 3.1. Let W = (u/^) be an n x n complex Hermitian random matrix with the 
invariant property such that UWU* has the same distribution as W for any unitary matrix 
U. For two sequences i = (ii, ...,«&) and j = . . . ,j k ), we have 

E[w idl w i2j2 ...w ikjk ]= ^(^)WgV-V;n)£[Tr r (WO]. 

a,T<=S k 

Before we prove this theorem we need the following lemma 

Lemma 3.2. Let W be as in Theorem \3.1[ W has the same distribution as UDU* , where 
U is a Haar distributed random unitary matrix, D is a diagonal matrix whose eigenvalues 
have the same distribution as those ofW, and D,U are independent. 

Proof. Let U, D be matrices (U unitary, and D diagonal) such that W = UDU*. It 
is possible to have U, D as measurable functions of W (if the singular values have no 
multiplicity this follows from the fact that U can be essentially chosen in a canonical way, 
and in the general case, it follows by an approximation argument). So, we may consider 
that U, D are also random variables and that the sigma-algebra generated by U, D is the 
same as the sigma-algebra generated by W. 

Let V be a deterministic unitary matrix. The fact that VWV* has the same distri- 
bution as W and our previous uniqueness considerations imply that VU has the same 
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distribution as U. By uniqueness of the Haar measure, this implies that U has to be 
distributed according to the Haar measure. 

To conclude the proof, we observe that instead of taking V to be a deterministic unitary 
matrix, we could have taken V random, independent from W, and distributed according 
to the Haar measure without changing the fact that VWV* has the same distribution as 
W . This implies that U can be replaced by VU, and clearly, VU is Haar distributed, and 
independent from D, so the proof is complete. □ 

Proof of Theorem \3.1l From Lemma 13.21 each matrix entry Wij has the same distribution 
as ^™=i u irdrUjr, where U = (uij) and D = diag(di, . . . , d n ) are unitary and diagonal 
matrices respectively and U, D are independent. It follows that 



J 12J2 ' ' W i k j k \ 



E[w hjl Wi 

^ E[d ri d r2 ■ ■ ■ d rk j • E[ui iri Ui 2 r2 ' ' ' ^i k r k ^jin ^jixz ' ' ' ^ifcnJ" 

r=(n,...,r k ) 

The unitary Weingarten calculus (Proposition 12. 1 p gives 



: E[d ri d r2 ---d rk ] S a (i,j)5 T (r,r)Wg lJ (a- 1 r 

r=(ri,...,r k ) <r,T£S k 

: ^(* 5 i)Wg u (<r-V;n) Yl S T (r,r)E[d n d r2 ---d 

r=(r 1 ,...,r k ) 



n 



CT,T€Sk 



To conclude the proof, we have to show: For r G and a diagonal matrix D = 
diag(di, ...,d n ), 

22 S T (r,r)d ri dr 2 ---dr k = Tr T (D). (3.1) 

r=(n,...,r h ) 

We observe that 5 T (r,r) survives if and only if all fj in each cycle of r coincide. Hence, 
if r has the cycle-type /i = . . . , /^), then 

5 T (r,r)d r ,d r2 ---d rk = C 1 ---< i =Tr( J D^)---Tr( J D^) = Tr T ( J D), 

r=(ri,...,r k ) 



which proves (13. ip . 

Example 3.1. Let W be as in Theorem 13.11 For each 1 < i < n and k > 1, 



EM 



1 



n(n + 1) • • • (n + k — 
summed over all partition u. of k. Here 



]~[Tr{W 



□ 



(3.2) 



n 

i>i 
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with the multiplicities mj(//) of i in /i. In fact, Theorem 13. II implies the identity -EfwfJ = 
So-es fe Wg u (cr; n) ■ ^2 reSk E[Tr T (W)), and the claim therefore is obtained by the following 
two known facts: 

£ Wg >' n > = n(n + l)-- 1 (n + fc-l) ; 

the number of permutations in S k of cycle-type \i is k\/Zp. When k — 1 the equation (I3.2p 
gives a trivial identity i£[wji] = -E^Ti^W)]. When k — 2,3, it gives 

« =^Vi) ^t Tr ^ 2 )] + ^PWD; 

3.1.2 Orthogonal case 

Theorem 3.3. Let W = (wij) be an n x n real symmetric random matrix with the 
invariant property such that UWU 1 has the same distribution as W for any orthogonal 
matrix U . For any sequence i = (ii, . . . , i<ik), we have 

E[w hh w i3i4 . . . w t2k _ ll2k ] = Yl CWWgV-V; n)E[Tr' T (W)}. 

<y,r€M2k 

Proof. As in Lemma 13.21 W has the same distribution UDU t , where U = (w^) and 
D = diag(cfi, . . . , d n ) are orthogonal and diagonal matrices respectively and U,D are 
independent. We have 

-E[u>j 1 j 2 u>j 3 j 4 . . . u^2k-i«2fc] 

^ ^ E[d ri d r2 ■ ■ ■ d rk ] ■ E[ui iri Ui 2ri Ui 3r2 Ui 4r2 ■ ■ • Ui 2k _ irh Ui 2hrk ], 

r=(n,...,r k ) 

and the orthogonal Weingarten calculus (Proposition 12.21) gives 

= Yl E[drAr 2 ---d rk ] £ S' a (i)6' T (f ) Wg° (^V; Tl) 
r=(ri,...,r k ) ^,T£M 2 k 

= C«Wg°(a- 1 r;n) £ 8' T (r)E[d n d r2 ■ ■ ■ d rh ], 

<r,TEM 2h r=(r 1 ,...,r k ) 

where r = (r l ,r 1 , r 2 , r 2 , . . . , r k , r k ) for each r = (r x , r 2 , . . . , r fe ). 

Recall notation defined in section [2.1.21 To conclude the proof, we have to show: For 
r G S 2 k and a diagonal matrix D = diag(<i 1 , . . . , d n ), 

S' T (r)d n d r2 ---d rk =Tv' T (D). (3.3) 

r=(n,...,r k ) 
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This equation follows from the following fact: 

5' T (r) survives if and only if all r« in each component of the graph T(r) coincide. □ 

Example 3.2. Let W be as in Theorem 13.31 For each 1 < % < n and k > 1, 



E\w. 



1 



n(n + 2)---(n + 2k- 2] 



8=1 



(3.4) 



In fact, Theorem 13.31 with the following two facts gives the claim: 

1 



E w s>> 

o-GA/ 2fe 



n(n + 2)---(n + 2A;-2) : 



the number of pair partitions in M 2 k of coset-type /i is 2 k k\/ (2 e ^ z^). When k — 2, 3, 
flU gives 

1 



n(n + 2) 
1 



(2E[Tr(W 2 )} + E[Tr(W) 2 }); 

(8E[Tr(W 3 )} + QE[Tr(W 2 ) Tr(W)\ + E[Tr(W) 3 }). 



n(n + 2)(n + 4) 

3.2 Left-right invariance 
3.2.1 Unitary case 

Theorem 3.4. LetX be a complex nxp random matrix which has the same distribution as 
UXV for any unitary matrices U, V. For four sequences i = (ii, . . . , i^), j — (ji, . . . , jk), 
i = (i[, . . . ,i' k ), j' = . . . ,j' k ), 

E S ai (i,i')5 a2 (jj')Wg V (7ra^W,n,p)E[Tr n (XX*)), 



E[Xi 1 j 1 ■ ■ ■ Xi k j k Xi> i j' i ■ ■ ■ %i' k j' k ) 



where Wg u (-;n,p) is defined in (12. 2p . 

Proof. As in Lemma [3.2[ we can see that X has the same distribution UDV*, where U 
and V are Haar distributed n x n and p x p random unitary matrices, respectively, and 
D is an n x p diagonal matrix whose singular values have the same distribution as those 
of X. Moreover, D, U, V are independent. 

Since each entry has the same distribution as Yl™^i Ui r d r W^., it follows from the 
independence of U, D, and V that 

E[Xi 1 j 1 ■ ■ ■ %i k j k Xi' 1 j' 1 " " " x i' k j' k ] 

= E E E[d ri ■ ■ ■ d rk d r[ ■ ■ ■ d r 'J 

r=(r 1 ,...,r k ) r'=(rj ,-,r' k ) 
X E[lli iri 
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Here r s , r' s run over 1, 2, ... , min(p, n). From the unitary Weingarten calculus (Proposition 
12. ip . we have 

= ^ 1 (*,* / )^ 2 U,/)Wg u K- 1 r 1 ;n)Wg u (a 2 - 1 r 2 ;p) 

x Y Y S Ti( r > r ')M r > f')E[d ri ■■■d rk d r r i --- d r ' k }. (3.5) 

r=(n,...,r fc ) r'=(ri,...,r^,) 

Since 5 Tl (r, r')5 T2 (r, r') = 1 if and only if r' s = r T2 ^ (1 < s < k) and 5 T -i T2 (r,r) = 1, we 
have 

Y Y 5 n (r, r')6 n (r, r')d ri - ■ ■ d rk d r > x ■■■d r > k 

r=(n,...,r k ) r'=(j^,....rj,) 

= Y 5 r- 1 r 2 ( r > r ) d n ■ ■ ■ dr k d ri ■ ■ ■ d rk , 
r=(n,...,r k ) 

which equals Tr T -i T2 (DD*) by (13. ip . Substituting this fact into (I3.5p . we have 

E i x iih ■ ■ ■ Xidk^ji ■ ■ ■ x i k j k } = Y (*>*') Mi,/) 

o-i,<T2es fe 

x ^ Wg u ( ( rr 1 ri;n)Wg u ( ( 7 2 - 1 r 2 ;p) J E;[ r & ri -i T2 (XX*)]. 

The proof of the theorem is follows from the following observation. 
Y WgVrVi;n)WgV 2 -V 2 ;p)Tr T - l7 jXX*) 

= Y Wg u ( ( xr 1 r 2 7r;n)Wg u ( ( T 2 : 1 r 2 ;p)Tr^ 1 (XX*) (•.• n = t 2 tt) 

T2,7Tg5 fc 

= ^ Wg u (7r ( rr 1 r 2 ;n)Wg u (r 2 -V 2 ;p)Tr^ 1 (XX*) (•.• Wg u (a;z) = Wg u (<7~ 1 ;z)) 

TT€S k 

At the last equality we have used the definition of Wg u (-; n,p). □ 
Example 3.3. If X satisfies the condition of Theorem 13.41 we have 

E[xijXvp\ = S iif S jf —E[Tr(XX*)}. 
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3.2.2 Orthogonal case 

Theorem 3.5. Let X be a real n x p random matrix which has the same distribution 
as UXV for any orthogonal matrices U, V. For two sequences i = (ii, . . . , i2k) o,nd j = 

(jl, ■ ■ - ,j2fe), 

E[x nn ---x l2k3 J = J2 S' ai (i)5' a2 (j)Wg°(na^a 2] n,p)E[Tr w (XX% 
where Wg°(-;n,p) is defined in (I2.4[) . 

Proof. In a similar way to the proof of Theorem 13.41 we have 
E[xi 1 j 1 ■ ■ ■ X{ 2k j 2k ] 

0"l,<72,Ti,T2eM2fc 

x £ W^{r)E[d ri ---d r2k ]. 

r=(n,...,r 2k ) 



We observe that 5' (r)S f (r) = 1 if and only if all r^ in each component of T(r 1 1 r 2 ) 
coincide. Letting (/zi, . . . , /ij) to be a coset-type of r-f V 2 we have 

r=(ri,...,r 2fc ) 

We thus have proved 

E[x hn ■ ■■x i2khh ] = Yl S' ai (i)5' a2 (j)Wg°(a^T 1 ; n)Wg°(^ 1 r 2 ; p) Tr'^jXX*). 

o"i,a-2,ri,T2GM 2 fc 

The remaining step is shown in a similar way to the proof of Theorem 13.41 (Replace a 

SUm J2a£M 2k 

by (2^!)- 1 E 

Example 3.4. If X satisfies the condition of Theorem 13.51 we have 

E[x ilh x i2J2 \ = S ilia 6 jlj2 — E[Tr(XX% 

4 Application to statistics 

4.1 Pseudo-inverse of a Ginibre matrix 
4.1.1 Complex case 

An n x p complex Ginibre matrix G is a random matrix whose columns are i.i.d. and 
distributed as n-dimensional normal distribution Nc(0, £), where £ is an n x n positive 
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definite Hermitian matrix. If G = UDV* is a singular value decomposition of G, the 
matrix G~ = VD~U* is the pseudo- inverse of G, where D~ is the pxn diagonal obtained 
by inverting point wise the entries of D along the diagonal (and zero if the diagonal entry 
is zero). 

Note that it is easy to check that the pseudo-inverse is well-defined in the sense that 
it does not depend on the decomposition G = UDV*. Actually, in the same vein as in 
section E2T21 where the pseudo-inverse is introduced in the context of Weingarten functions, 
the properties GG~G = G, G~GG~ = G~ together with the fact that GG~,G~G are 
selfadjoint, suffice to define uniquely the inverse. If the matrix is invertible, the pseudo- 
inverse is the inverse (this notion of pseudo-inverse is sometimes known as the Moore- 
Penrose pseudo inverse). 

Theorem 4.1. Let G~ = (g y ) be the pseudo-inverse matrix of an n x p complex Ginibre 
matrix associated with an n x n positive definite Hermitian matrix S. Put q = p — n and 
suppose n,q > k. For four sequences i = (i x , . . . , i k ), j = (ji, . . . ,j k ), *' = • • • , i' k ), 
and? = ...,? k ), we have 

E[g tljl ■ ■ ■ g ikjk gWi ■ ■ ■ gWk] 
=(-l) fc E OWgV-W, -gXE-i)^, • • • (X-% (k)j >, 

a,peS k 

where Wg u (-;p, —q) is defined in (12. 2p . 

Proof. Let Z be an nxp matrix of i.i.d. Nc(0, 1) random variables. Then it is immediate to 
see that Y}I 2 Z has the same distribution as G. Therefore each <? u has the same distribution 
as Y^r=i zir (^ _1//2 )n'5 where Z~ = (^ y )i<i<p,i<j<n is the pseudo-inverse matrix of Z, and 
hence 

k 

E[g^ ■ ■ ■ g^gW.-.g^} £ E U^^W^L 

r=(r!,...,r k ) r'={r' v ...,r' k ) s=l 

x E[z iiri ■ ■ ■ z^z^-'-z^]. 
Since Z~ is a p x n matrix satisfying the condition on Theorem I3.4[ we have 

E[z hn ■ ■ ■ z ikr "z i 'i r i ■■■z i 'k r 'k] 
= E S a (i,i')S p (r,r')Wg v (a- 1 7rp;p,n)E[Tr 7 ,(Z-(Z-y)}. 

a,p,TreS k 

Moreover, from the condition of q = p — n > k, we can apply Proposition 12.31 with 
W = ZZ\ and 

E[Tr n (Z-(Z-y)} = ElTr^W- 1 )] = (-l) k £ Wg^Trr" 1 ; -g) Tr T (/ n ), 
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where I n is the n x n identity matrix. Note that Tr r (I n ) = n K<yT \ Hence we have obtained 



E[g Hn ■ ■ ■ g^gWi ■ ■ • gVk] 

-(-l) k Yl S a (i,i')n^Wg lJ ( ( r-\p ] p,n)Wg lJ (n- 1 r;- q ) 



o-,p,ir,T&S k 

_ k 

X 



e e ^(^^ri( s_i/2 )^( E - i/2 )^ 



r=(n,...,r k ) r'=(r[,...y k ) s-1 



r sfs 



A direct calculation gives 

n K(r) Wg u (a^ 1 7rp;p,n)Wg u (7r- 1 r; -q) 

TT,ms k 

= E Wg u (p(T- 1 7r;p,n)Wg u (7r- 1 r;-g)n K(r " 1) 

= [Wg u (-;p) * Wg u (-; n) * Wg u (-; -q) * n^](pe- 1 ). 
Since n K ^ * Wg u (-; n) = 5 e when n > k, we have 

E n K ^Wg lJ (a- 1 np; P ,n)Wg lJ (n- 1 r;-q)=Wg lJ (a- 1 p ] p,-q). 

ir,reSk 

On the other hand, it is easy to see that 

E E S &> T ') \\^ 1/2 )r^- l/2 )r^ 

r=(n,...,rk) r'=(r' 1 ,...,r' k ) s=l 

= e n^n^- 1 ^— e fi(s- i/2 ), P(s) M S ,( s - i/2 )M S ,^ 

ri,...,r k s=l ri,...,r k s=l 

=n (e( s ~ i/2 w( s - i/2 )^) =n( s - i w- 

s=l \ r / s=l 

We thus have completed the proof of the theorem. □ 
Example 4.1. For G given as in Theorem 14.11 



1 

p(p — n) 
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4.1.2 Real case 

An nxp real Ginibre matrix G is a random matrix whose columns are i.i.d. and distributed 
as n-dimensional normal distribution Nr(0, E), where E is an n x n positive definite real 
symmetric matrix. 

Theorem 4.2. LetG~ = be the pseudo-inverse matrix of an nxp real Ginibre matrix 
associated with an nx n positive definite real symmetric matrix E. Put q = p — n — 1 and 
suppose n > k and q > 2k — 1. For two sequences i = (ii, . . . , i 2 k) and j = . . . , j 2 k), 
we have 

£[^V 2j2 • • -9 hkhk ] = (-1)* E CWWgV-V^-g) J] (E- 1 )^, 

cr,peM 2fc {a,b}Gp 

where Wg — g) zs defined in (12. 4p . 

Proof. The proof is similar to that of the complex case if we use Theorem 13.51 Proposition 
12.4} and the following identity: for each a G M 2 k, 

2 k 

e n( s_i/2 )^ = n ( 4 - x ) 

T-=(ri,...,r 2 fc) s=l {a,b}ecr 

which is verified easily. □ 
Example 4.2. For G given as in Theorem 14. 2 [ 



1 

12 p(p — n — 1) 



4.2 Inverse of compound Wishart matrix 
4.2.1 Complex case 

Let E be an n x n positive definite Hermitian matrix and let B be a p x p complex matrix. 
Let Z be an n x p matrix of i.i.d. Nc(0, 1) random variables. Then we call a matrix 

W = T} /2 ZBZ*T} /2 

a complex compound Wishart matrix with shape parameter B and scale parameter E, 
where E 1//2 is the hermitian root of E. 

Remark 4.1. If E = J n , then the corresponding compound Wishart matrix is called 
white (or standard) compound Wishart. If B is a positive-definite matrix, then the 
corresponding compound Wishart matrix can be considered as a sample covariance matrix 
under correlated sampling as explained in [BJJN PZj. 
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Theorem 4.3. Let £ be an n x n positive definite Hermitian matrix and B be a p x p 
complex matrix. 

Let W~ x = (w 1 ^) be the inverse matrix of annx n complex compound Wishart matrix 
with shape parameter B and scale parameter £. Put q = p — n and suppose n,q > k. For 
two sequences i = (ii, . . . ,i k ) and j = (ji, . . . ,jk), we have 

a, P es k 

Proof. The matrix W has the same distribution as GBG*, where G is an n x p Ginibre 
matrix associated with E. If we write B~ = and G~ = (g^), then 

E[w lljl ■ ■ ■ w ikjk ] = Yl ^ ' ' ' b rkr '*E[g r ^ ■■■g r ^g< jl ■ ■ ■ g< jk }. 

r=(n,...,r k ) r=(r' 1 ,...,r' k ) 

Moreover, it follows from Theorem 14.11 that 

e[ w **... w u>] =(-i) k Y ^ v (^ 1 p^p,~Q)(^%^r--^-% w r k 

a, P es k 

x Y Y S a (r,r')b rir ^--b r ^. 

r=(n,—,r k ) r=(r' 1 ,...,r' k ) 

We finally observe that 

Y Y k( r > r '^ brir ' 1 ■ ■ ■ hTkr ' k = Y hrir ° {1) ■ ■ ■ &rfcMfc) = Tr -( B ~)- 

r=(n,...,r k ) r=(r[,...,r' k ) r=(n,...,r k ) 

□ 

Remark 4.2. If S = /„ (in the white compound Wishart case), one can observe that a 
simplification occurs in the above formula. 

In turn, this simplification has the following probabilistic explanation: the joint distri- 
bution of the traces of W, W 2 , . . . has the same law as the joint distribution of the traces of 
W, W 2 , . . ., where W is a (non-compound) Wishart distribution of scale parameter B 1 ! 2 . 

Therefore we can use existing results for the inverse of non-compound Wishart matrices 
in order to work out this case. 

4.2.2 Real case 

Theorem 4.4. Let S be an n x n positive definite real symmetric matrix and B a p x p 
real matrix. Let W~ 1 = be the inverse matrix of an n x n real compound Wishart 

matrix with shape parameter B and scale parameter S. Put q = p — n — 1 and suppose 
n > k and q > 2k — 1. For any sequence i = . . . , 12k), we have 

E[w hi2... w i* k -ii* k] = (_!)* ^2 TrUinwgV-v^-g) n ( E_1 )w*- 

<T,p£M 2 k {u,v}£p 

Proof. The proof is parallel to the complex case. We shall leave it to the readers. □ 
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